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Eight  undergraduate  plot  training  students  were  trained  to  specified  levels  of  performance  in  sH  major  areas  of 
bade  pOot  training  udng  the  Advanced  Similator  for  Underpaduate  Pilot  Training  (ASUPT);  half  were  trained  uring 
the  platform  motion  qrstem  and  half  without  Subsequently,  tljey  completed  bade  pilot  training  (to  Ah  Training 
Command  (AT C)  phase  standards)  in  T-37  aircraft.  Training  houn  required  and  check  ride  scores  were  compiled  for 
each  subject.  Similar  data  ware  collected  for  a control  group  of  eight  subjects  trained  tnktg  the  conventional  ATC 
syllabus.  Udng  data  obtained  from  both  groups,  estimates  of  transfer  of  training  percentages,  and  training 
effectiveness  ratios  were  computed. 
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Simulator  trained  atudents  required  fewer  aircraft  howa  in  al  arena  of  bade  WT  and  achieved  check  ride 
acotea  equal  to  or  better  than  the  control  group.  No  rtgaiilcant  or  practical  differences  were  documented  between 
performances  of  die  motion  and  no-motion  trained  groups  far  any  category  of  maneusen. 

This  was  a first  effort  to  incorporate  a full  mtatan  rinuiktor  into  an  operational  pilot  training  program. 
Several  problem  areas*  were  identified  which  must  be  solved  before  fun  suoceaa  can  be  achieved.  Thera  tame  problem 
ahould  be  relevant  to  application  of  other  M mission  simulators  b>  other  training  programs,  fat  addition,  aoma 
ASUPT  deficiencies  were  identified. 
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Problem 

Hie  primary  objective  of  this  exploratory  study  was  to  investigate  the  utility  of  the  Advanced 
Simulator  for  Undergraduate  Riot  Training  (ASUPT)  as  a full  mission  simulator  in  the  basic  phase  of  Air 
Force  undergraduate  pilot  training  (UPT).  Secondary  objectives  included  identification  of  problem  areas  in 
using  a full  mission  simulator,  equipment  problems,  and  the  effectiveness  of  simulator  platform  motion  in 
UPT. 

Approach 

A sample  of  eight  UPT  subjects  were  given  simulator  training  to  a satisfactory  level  in  all  flight  skill 
areas  of  training  included  in  the  basic  phase  of  UPT;  four  were  trained  using  simulator  platform  motion  and 
four  without.  Following  this,  the  students  completed  training  in  T-37  aircraft.  The  average  performance  of 
this  group  was  compared  with  the  average  performance  of  a sample  of  eight  students  trained  using  the 
regular  UPT  syllabus.  Estimates  of  training  transfer  and  training  effectiveness  ratios  were  computed.  In 
addition,  problems  occurring  during  the  conduct  of  the  study  were  documented. 

Results 

Training  transfer  estimates  for  all  major  training  areas  were  as  follows:  Advanced  Contact,  4%; 
Formation,  13%;  Navigation,  13%;  Instruments,  38%;  Basic  and  Presolo,  4S%;  with  an  overall  average  of 
23%.  Training  effectiveness  ratios  were  computed  for  the  same  areas  of  training  and  were  as  follows, 
respectively:  0.1 1,  1.00,  0.24,  0.S2, 0.60,  and  0.48  overall.  No  differences  in  performance  were  observed 
between  subjects  trained  using  platform  morion  and  those  trained  without  the  use  motion.  A comparison  of 
average  aircraft  check  ride  scores  for  instruments  and  contact  flight  revealed  that  the  experimental  group 
performed  significantly  better  on  the  contact  check  ride.  A summary  of  student  and  instructor  opinions 
revealed  a number  of  advantages  and  problems  in  the  use  of  the  simulator.  A finding  of  particular 
significance  was  that  if  a full  mission  simulator  is  to  be  incorporated  into  a training  program,  the  syllabus 
must  be  planned  to  provide  maximum  flexibility  in  both  aircraft  and  academic  scheduling. 

Conclusions 

A sophisticated  T-37  flight  simulator  provides  a potential  for  effectively  reducing  flying  requirements 
for  major  training  areas  in  the  T-37  UPT  syllabus.  While  the  sample  sizes  were  too  small  for  high  confidence 
conclusions,  there  was  no  evidence  in  this  study  that  platform  motion  in  the  simulator  provided  an  increase 
in  transfer  of  training.  If  a full  mission  simulator  is  to  be  successfully  applied  to  a total  training  program, 
scheduling  flexibility  for  both  equipment  and  ground  school  will  be  an  essential  requirement. 
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FULL  MISSION  SIMULATION  IN  UNDERGRADUATE  PILOT  TRAINING: 
AN  EXPLORATORY  STUDY 


I.  INTRODUCTION 

The  concept  of  procuring  an  Advanced  Simulator  for  Undergraduate  Pilot  Training  (ASUPT)  was 
initiated  in  1967  as  a task  area  within  a Director  of  Defense  Research  and  Engineering  program  entitled 
Innovations  in  Training  and  Education  (INNOVATE).  The  objective  of  the  ASUPT  task  area  was  to  design, 
develop,  and  utilize  a state-of-the-art  advanced  simulation  system  for  investigating  the  role  of  simulation  in 
’ pilot  training. 

In  December  1974,  the  ASUPT  was  accepted  as  installed  at  Williams  AFB,  AZ.  At  the  time  of  its 
acceptance,  it  represented  the  most  sophisticated  full  mission  simulator  in  existence.  It  consisted  of  two 
high-fidelity  T-37  cockpits  mounted  on  individual  synergistic  six  degree-of-freedom  motion  systems 
surrounded  by  a visual  system  which  displayed  computer-image-generated  scenes.  A complete  array  of 
advanced  instructional  feature  capabilities  was  available,  although  not  all  of  these  features  were  fully 
developed  for  immediate  operational  research  application.  (Fora  more  detailed  description  of  ASUPT,  see 
AFHRL-TR-74-43,  pages  17-26.)  The  next  several  months  were  spent  developing  software  to  implement 
the  advanced  training  features  and  to  debug  the  ASUPT  when  used  as  a training  device. 

Obviously,  planning  for  the  most  efficient  research  utilization  of  a device  possessing  all  the 
capabilities  of  ASUPT  was  complex;  there  were  many  simulation  research  issues  for  which  data  were 
urgently  needed.  For  example,  earlier  studies  conducted  by  Air  Force  Human  Resources  Laboratory,  Flying 
Training  Division  (AFHRL/FT)  using  a T-4G  simulator  (equipped  with  a two  degree-of-freedom  motion 
system  and  a one  window  field  of  view  visual  system)  indicated  that  48%  of  the  instrument  training  hours 
and  10%  of  the  basic  contact  hours  used  in  the  T-37  phase  of  UPT  could  be  completed  in  a simulator 
(Woodruff  & Smith,  1974).  A follow-on  question  was  “How  much  additonal  time  could  be  saved  using  the 
ASUPT  configured  to  resemble  the  UPT  Instrument  Flight  Simulator  (IFS)?”  Other  issues  involved  the 
effects  of  motion  on  training,  the  field  of  view  required  for  various  categories  of  maneuvers,  interactions  of 
motion  and  visual  systems,  etc.;  however,  the  uniqueness  of  the  ASUPT  which  set  it  apart  from  any  other 
device  in  existence  was  its  total  UPT  mission  capability.  Therefore,  one  of  the  eailier  studies  planned  was 
investigation  of  the  use  of  the  ASUPT  in  all  phases  of  UPT  T-37  training. 

This  report  provides  a description  of  the  first  effort  in  using  a full  mission  simulator  in  a total  training 
role.  The  objectives  of  the  effort  were:  (a)  to  identify  syllabus  development  and  scheduling  problems,  (b)  to 
identify  features  of  the  ASUPT  which  need  improvement  to  permit  effective  training,  (c)  to  provide  an 
opportunity  for  research  personnel  to  employ  all  ASUPT  capabilities  and  features  in  the  training  role,  (d)  to 
provide  an  early  test  of  the  instrument  training  syllabus  being  developed  for  the  IFS,  (e)  to  provide  a first 
(but  by  no  means  final)  baseline  estimate  of  what  training  effectiveness  could  be  achieved  by  a full  mission 
simulator  in  UPT,  and  (f)  to  obtain  initial  information  on  the  effects  of  simulator  motion  on  simulator 
training  effectiveness. 


II.  METHOD 

Test  Plan 

As  in  the  development  of  any  test  plan,  consideration  was  given  to  many  conventional  study  design 
characteristics;  however,  in  this  study,  two  of  those  considered  were  of  such  significance  as  to  require 
explanation.  First,  the  ASUPT  possessed  some  capability  for  use  in  all  phases  of  UPT  of  which  most,  unlike 
instrument  training,  had  never  been  addressed  in  any  training  program  involving  simulator  scheduling. 
Therefore.it  was  anticipated  that  despite  prestudy  planning  efforts,  a number  of  unforseen  student /syllabus 
flow  problems  would  be  encountered  Second,  while  a basic  experimental  paradigm  which  included  three 
groups  of  subjects  would  have  been  desirable  (the  first  trained  using  a special  syllabus  and  the  ASUPT,  the 
second  trained  using  only  the  special  syllabus,  and  a third  trained  using  the  conventional  syllabus),  such  a 
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design  was  impractical  until  more  was  known  relative  to  the  number,  type,  and  significance  of  problems 
which  would  be  encountered  while  using  the  ASUPT  in  a total  mission  training  role.  As  a result  of  these  and 
other  considerations,  the  study  was  planned  to  be  exploratory,  and  the  requirement  for  a control  group 
trained  using  the  new  syllabus  without  the  ASUPT  deleted.  However,  since  Air  Training  Command  (ATC) 
was  implementing  a new  T-37  phase  syllabus  with  the  same  class  planned  for  this  study,  training  data  on  a 
sample  of  these  students  would  be  collected  for  comparative  data.1 


Eight  students  (the  experimental  group)  were  trained  in  all  flying  skills  included  in  the  basic  phase  of 
UPT  using  flte  ASUPT.  Half  of  these  students  received  training  with  the  ASUPT  motion  system  operational 
and  half  with  the  motion  system  off.  After  simulator  practice,  all  students  proceeded  to  T-37  aircraft  and 
completed  all  basic  pilot  training  requirements  to  phase  standards  as  specified  in  the  ATC  July  1975 
syllabus  (ATC,  1975).  Students  were  given  the  required  ATC  check  rides,  administered  by  the  96th  Flying 
Training  Squadron  Check  Section,  as  soon  as  judged  ready  by  their  instructor  pilots  (IP).  Academic  training 
was  completed  on  the  same  schedule  as  the  remainder  of  their  assigned  class. 


Eight  additional  students  were  selected  as  a control  group,  and  their  progress  through  the  regular  UPT 
program  was  monitored.  No  special  treatment  was  specified. 


Data  collected  for  both  group*  included  the  number  of  simulator  and  aircraft  hours  used  in  each 
phase  erf  training  and  check  score*  achieved  on  T-37  aircraft  check  tides.  In  addition,  their  performance  was 
followed  through  the  T-38  phase  of  UPT  to  obtain  some  information  concerning  longer  range  effects  of  the 
special  treatment. 


Two  minor  conditions  of  the  motion/no-motion  portion  of  this  test  need  to  be  mentioned  because  of 
their  possible  influence  on  the  results.  First,  the  ASUPT  Geest  was  not  used  in  order  to  make  conditions 
comparable  to  a previous  motion/no-motion  investigation  at  this  laboratory.  Second,  one  exception  was 
made  to  the  treatment  of  the  no-motion  group.  Since  aircraft  buffet  is  a primary  cue  of  impending  stall  in 
file  T-37  and,  in  the  opinion  of  the  IPs,  simulator  training  without  these  cues  would  be  ineffective,  the  use 
of  motion  when  teaching  stalls  was  permitted  for  all  students. 


Syllabus 

The  special  syllabus  of  instruction  developed  for  training  the  experimental  students  closely  paralleled 
the  ATC  July  1975  syllabus.  It  was  arranged  in  blocks  of  training;  each  block  contained  a group  of  lades 
considered  to  be  prerequisite  to  learning  the  tides  in  the  succeeding  block.  Simulator  and  aircraft  training 
were  interspersed  to  minimize  delays  between  training  in  the  simulator  and  demonstrating  perfornunoe  in 
the  aircraft.  Students  were  progressed  on  a proficiency  basis;  however,  to  meet  scheduling  constraints, 
minimum  and  maximum  numbers  of  sorties  were  specified  for  each  block.  Performance  standards  requited 
for  advancement  were  dearly  defined.  Check  ride*  were  given  in  the  ASUPT  before  going  to  the  T-37  for 
the  first  time  and  after  ASUPT  instrument  training  to  ensure  that  each  student  met  file  specified  level  of 
performance  in  the  simulator  before  using  aircraft  hours;  extra  ASUPT  training  was  given  to  students  who 
failed  to  meet  the  specified  standard*.  A thorough  description  of  the  syllabus  development,  structure,  and 
use  is  contained  in  Weyer  and  Puller,  1976. 


Subjects 


Experimental  Group.  Eight  students  were  selected  randomly  from  incoming  UPT  dan  76-09  at 
Williams  Air  Force  Base,  Arizona.  Selection  was  limited  to  USAF  students  whose  records  indicated  th^r 
had  lest  than  SO  hours  prior  flying  training  and  who  were  not  Air  Force  naviptors.1 


*To  maintain  clarity  for  die  remainder  of  the  report,  the  standard  terma  "experimental"  and  " control”  ponge  wB 
be  need  with  die  fall  undemanding  that,  in  the  atrict  experimental  aeaae,  the  poupe  involved  do  not  meat  accapwd  criteria 
for  such  designations. 

*It  was  discovered  later  that  one  of  the  (elected  student!  did  have  about  200  hours  prior  lfht  ahplaat  experience, 
which  wee  not  shown  in  die  record*  when  selection  wa*  made.  This  student  turned  out  to  be  better  than  average,  but  not 
exceptional  in  die  subject  group. 
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Two  students  from  the  original  sample  were  lost  shortly  after  training  in  ASUPT  began;  one  because 
of  withdrawal  of  a medical  water  and  the  other  due  to  failures  cm  several  academic  tests  and  unsatisfactory 
propers  in  the  simulator.* 

A third  student  included  in  the  original  sample  experienced  difficulty  in  his  early  ASUPT  training  and 
required  die  maximum  time  programmed.  When  later  scheduling  problems  resulted  in  further  delay,  he  was 
moved  back  to  dear  76-10.  Thus,  five  students  from  dass  76—09  and  three  from  76-10  were  in  the 
subject  group  which  completed  the  experimental  program. 

Control  Group.  Using  the  same  criteria  as  used  with  the  experimental  group,  eight  additional  students 
were  selected  from  the  regular  training  propam  to  serve  as  a control  group.  It  was  the  goal  of  the  regular 
training  program  to  maintain  an  average  of  90  flying  training  hours,  but  some  variation  was  permitted, 
making  the  use  of  a comparison  sample  appropriate.  Hue  students  were  chosen  from  class  76-09  and  three 
from  76-10  to  provide  a control  group;  this  composition  paralleled  that  of  the  experimental  group. 

Instructor  Pilots 

Seven  IPS  from  the  8 2d  Flying  Training  Wing,  Williams  AFB,  A Z,  participated  in  this  test  program. 
Bach  IP  was  assigned  a single  student,  except  for  one,  who  was  assigned  two.  IP -student  relationships  were 
the  same  as  in  fire  normal  training  program.  The  IPs  were  given  instruction  and  experience  in  the  operation 
of  fire  ASUPT  instructor  consoles  and  in  flying  ASUPT  from  the  right  seat  in  the  cockpit.  Since  no  prior 
comparisons  of  the  relative  effectiveness  of  using  either  IP  position  had  been  made,  the  IPs  were  instructed 
on  file  operation  of  each  station  and  were  permitted  to  use  the  position  they  felt  would  allow  them  to 
instruct  most  effectively. 

Proficiency  Advancement 

Students  programed  in  both  the  simulator  and  rite  aircraft  according  to  their  demonstrated 
proficiency.  Proficiency  advancement  in  the  simulator  was  used  in  recognition  of  individual  differences  in 
teaming  rate  and  to  promote  efficient  use  of  ASUPT.  hi  the  aircraft,  however,  its  primary  purpose  was  tc 
permit  assessment  of  benefit  derived  from  simulator  training  by  noting  differences  in  flying  hours  required 
by  experimental  and  control  group  students. 

IPOpWonQnestiosmaiiea/InServlewi 

A questionnaire  about  ASUPT  capabilities  was  administered  to  the  IPs  after  they  had  observed 
student  performance  in  the  aircraft  (lx.,  after  baric  contact  and  presolo  student  training  in  ASUPT.) 

At  the  end  of  rite  program,  the  IPs  were  also  interviewed  extensively  concerning  human  engineering 
design  of  the  ASUPT  operator  and  Instructor  positions.  Due  to  the  volume  of  this  material,  it  is  not 
jndudnd  in  this  report; it  will  be  published  in  a separate  document. 
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HL  RESULTS  AND  DISCUSSION 

Badier  studies  conducted  by  AFHRL/FT  indicated  that  a more  definitive  means  of  measuring  training 
effectiveness  is  the  uae  of  trials  to  criterion  (as  opposed  to  training  hours).  The  use  of  such  a measure 
permits  omission  of  nonreierant  overhead  flying  time  (i.e.,  proceeding  to  and  from  a practice  area); 
however,  daa  to  the  exploratory  nature  of  this  study,  it  was  decided  that  the  conventional  measure  of  hour* 
wodd  be  need  thereby  reducing  DP  training  time  required  for  both  experimental  and  control  group  IPk  and 
investigator  monitoring  time  requited  over  the  extended  period  of  the  study.  Therefore,  discussions 
owshiIh  training  effectiveness  results  obtained  in  this  study  will  be  in  terms  of  simiiator  or  aircraft 


*k  nrr'rn  with  s prior  afntmtnt  with  ATC,  ht  was  isawvod  from  the  test  protram  and  returned  to  refular 
tndnlnt  with  Ms  data;  he  waa  later  eHminated  from  plot  traWnf. 
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Table  1 provides,  a summary  of  ASUPT  and  T4  trainer  hours  used  by  the  experimental  and  control 
groups,  respectively.  These  hours  are  drown  by  category  of  training  and  reflect  time  spent  in  learning  flying 
skill  objectives.  Additional  simulator  hours  (5.6)  were  used  by  each  student  in  learning  normal  and 
emergency  procedures  training;  however,  since  these  were  enabling  objectives,  and  the  same  for  all  students, 
they  were  omitted  from  the  totals  in  Table  1. 

Table  l.  Simulator  Flying  Hours  Used  by  Experimental  and  Control 
Group  Students  by  Segments  of  UPT,  Totals  and  Averages 


Forma- 

tion 


7.7 

58.3 

7.8 

65.9 

8.2 

52.6 

7.5 

58.3 

7.8 

60.3 

7.8 

55.9 

7.8 

54.4 

7.5 

70.2 

• 7.8 

59.5C  j 

3 2 

17.6 

3.2 

16.8 

Averages  baaed  on  only  those  students  who  flew  simulator  missions. 

^The  simulator  used  by  the  control  group  was  the  T-4. 

‘Average  total  includea  students  who  did  not  train  in  formation  and  nisht  flying. 


The  four  columns  in  Table  1 which  have  no  entries  for  the  control  group  section  (he.,  1 , 2, 3,  and  5), 
reflect  UPT  simulator  training  objectives  that  can  be  addressed  only  if  a visual  system  is  available. 
Experience  with  the  ASUPT  indicated  most  training  objectives  in  Basic  and  Presolo,  and  Advanced  Contact 
could  be  practiced;  however,  practice  on  Night  Flying  and  Formation  was  different.  For  Nigit  Flying, 
only  one  aircraft  ride  is  given,  and  it  is  basically  for  experience.  It  is  not  a check  item;  therefore, 
proficiency  in  the  simulator  was  not  specified,  and  the  practice  ride  was  given,  only  if  time  permitted.  (It 
urea  the  general  consensus  of  the  IPs  that  the  ASUPT  night  scene  available  at  the  time  was  inadequate  for 
effective  night  transition  training.) 

With  respect  to  formation  training  in  ASUPT,  no  students  had  been  trained  using  the  formation  seme 
prior  to  this  study.  After  a few  trials,  it  became  apparent  that  ASUPT  was  extremely  difficult  for  beginning 
Mudenta,  and  it  was  decided  that  little  training  would  be  achieved.  As  a result,  this  training  area  w» 
deei mphaatod  and,  in  some  esses,  omitted  if  any  scheduling  problems  occurred.  (The  validity  of  this 
decUon  is  diecueeed  further  in  foe  Results  section.) 
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Aircraft  Flying  Hours 

fable  2 provides  a summary  of  T-37  aircraft  flying  hours  used  by  each  student  who  participated  in 
this  study;  average  and  total  times  for  both  the  experimental  and  control  groups  are  included.  The  first 
eleven  vertical  columns  represent  all  segments  of  the  flying  training  program;  when  summed  across,  the 
total  is  the  number  of  T-37  aircraft  hours  used  by  each  individual.  Not  all  of  the  times  shown  in  these 
columns  were  subject  to  reduction  as  a result  of  simulator  training.  For  example,  columns  2, 4,  and  S were 
ATC  required  sorties  and  were  irreducible  (one  aircraft  sortie  ranged  from  1.1  to  1.5  hours).  Differences  in 
column  3 occurred  as  a result  of  IP  recommendations  wherein  it  was  believed  that  only  one  area  solo  tide 
was  required,  whether  or  not  a simulator  was  used.  Columns  7 and  9 reflect  mandatory  check  ddes  which 
required  at  least  one  sortie  each  per  student;  hours  in  addition  to  one  sortie  in  each  of  these  columns 
indicate  that,  for  some  reason,  some  number  of  rechecks  was  necessary.  The  remainder  of  the  columns 
(e.g.,  1,  6,  8,  10,  and  1 1)  show  aircraft  hours  used  in  areas  of  training  where  simulator  effectiveness  was 
relevant,  and  where  the  computation  of  hours  saved  and  training  effectiveness  ratios  (TER)  as  included  at 
bottom  of  Table  2,  were  appropriate. 

As  noted  earlier,  to  meet  operational  scheduling  constraints,  the  study  syllabus  included  an  estimated 
maximum  schedule  of  75.3  hours  per  student  as  compared  to  the  90  hours  required  in  the  regular  syllabus. 
This  estimate  was  based  on  the  judgement  of  instructor  pilots  and  scientists  who  were  experienced  in  the 
use  of  simulators  in  pilot  training.  Table  2 shows  that  two  students  exceeded  75.3  hours.  These  two 
experimental  students  used  dose  to  the  maximum  scheduled  syllabus  hours  in  early  phases  of  training,  and 
then  both  failed  their  instrument  checks.  The  experimental  syllabus  provided  that  a student  who  failed  a 
category  check  ride  was  “. . .authorized  additional  hours  to  increase  his  flying  time  in  that  category  up  to 
that  spedfied  in  the  ATC  syllabus. . .”  (Weyer  & Fuller,  1976);  additional  flying  time  received  under  this 
provision  pushed  their  totals  beyond  the  75.3  estimate. 

Figures,  presented  in  the  % Saved  row,  were  computed  using  the  average  hours  for  each  group  and 
indicate  the  percent  of  hours  required  in  the  regular  syllabus  which  were  not  required  by  the  experimental 
group.  As  noted  earlier,  these  savings  cannot  necessarily  be  attributed  to  ASUPT ; they  could  have  resulted 
from  the  revised  syllabus;  however,  since  the  study  syllabus  dosely  paralleled  that  used  in  the  regular 
course,  it  is  believed  that  most  of  the  differences  did  result  from  use  of  the  ASUPT. 

While  a reduction  of  38%  in  instrument  training  time  (Table  2,  Column  8)  over  a new  UPT  syllabus 
(which  had  already  reduced  the  required  aircraft  training  hours  from  20.8  to  14.4)  was  respectable,  it  was 
less  than  anticipated;' particularly  considering  that  ATC  was  interested  in  obtaining  validation  for  the 
dedsion  that  only  check  rides  would  be  required  in  the  aircraft  when  the  IFS  became  available  (ATC,  1975, 
p.  45).  The  instrument  training  portion  of  the  test  syllabus  was  planned  to  partially  validate  this  concept 
and  iristructors  were  encouraged  to  hold  aircraft  instrument  training  flights  to  two  sorties,  if  possible.  (A 
maximum  of  six  aircraft  sorties  was  programmed  in  the  syllabus.)  The  Ift  followed  this  guidance  tempered 
by  their  own  judgement.  The  result  was  that  four  of  the  eight  test  subjects  failed  their  first  instrument 
check;  one  of  these  failed  his  recheck.  Reasons  noted  for  the  failures  induded:  pentration  using  the  wrong 
very  high  frequency  omnirange  (VOR)  station,  failure  to  lower  flaps  on  a ground  controlled  approach 
(GCA),  poor  altitude  control  on  a GCA,  and  faulty  instrument  crosscheck  on  a GCA. 

Several  factors  were  suggested  as  contributing  to  the  problem.  First,  the  actual  aircraft  instrument 
check  used  in  the  new  syllabus  was  more  difficult  for  all  students;  24%  of  the  regular  dass  failed  their  first 
check  ride.  Second,  IPs  were  permitted  to  instruct  from  whatever  ASUPT  station  they  desired;  usually  the 
external  console.  From  the  console,  they  could  not  adequately  detect  or  correct  basic  weaknesses  such  as 
student  visual  crosscheck  procedures  which  required  direct  observation  of  student  practices.  Third,  the  IPs 
spent  considerable  time  at  the  console  acting  as  GCA  controllers.  The  GCA  display  and  the  repeater  flight 
instruments  were  widely  separated;  as  a result,  effective  instruction  time  may  have  been  reduced.  Fourth, 
students  had  received  check  rides  in  the  simulator,  and  their  average  performance  was  not  regarded  as 
outstanding;  however,  there  was  no  official  pass-fail  status  to  this  check.  Finally,  by  the  time  the  aircraft 
instrument  check  was  received,  each  student  (and  instructor)  had  spent  at  least  50  hours  in  the  ASUPT. 
Since  no  official  recognition  was  provided  for  these  efforts  (i.e.,  accredited  flying  time),  and  because 
simulator  check  ride  success  was  not  an  official  criterion  for  getting  through  the  program,  it  is  believed  a 
lack  of  motivation  existed.  In  summary,  the  conduct  of  this  exploratory  study  identified  several  problem 
areas  which  should  be  resolved  prior  to  the  conduct  of  subsequent  studies  and  before  simulators  such  as  the 
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IPS  can  be  expected  to  be  used  with  maximum  efficiency.  Many  of  these  can  be  corrected  through  syllabus 
revisions  and  increased  control  of  the  learning  situation.  In  fact,  since  the  study  was  exploratory,  some 
treatment  changes  were  instituted  with  the  two  students  from  class  76-10  (Table  2,  F and  G)  and  proved 
successful.  These  included:  IP  located  in  the  cockpit,  extra  people  to  serve  as  GCA  controllers,  and 
de-emphisis  on  saving  hours.  These  subjects  passed  simulator  checks  with  better  ratings,  and  each  pasted  his 
first  aircraft  check  ride. 

Student  performance  in  other  areas  of  ASUPT  training  (all  contact  flying)  shows  various  results.  For 
example,  results  achieved  in  Basic  and  Presolo  (Column  1)  were  about  as  anticipated  and  support  the 
philosophy  that  simulators  can  be  used  very  effectively  in  early  stages  of  flying  skill  development. 

The  results  obtained  in  Advanced  Contact  (Column  6)  were  disappointing;  however,  this  showing  is 
partially  a reflection  of  the  instrument  check  failure  discussed  earlier.  Most  of  the  Advanced  Contact  work 
occurred  after  tire  instrument  check  rides  and,  since  the  check  ride  failures  resulted  in  an  unanticipated 
requirement  for  additional  aircraft  sorties  (for  review  and  recheck),  it  was  necessary  to  use  aircraft 
scheduled  for  contact  training  to  satisfy  the  instrument  training  requirements.  Normal  ATC  operations 
required  aircraft  to  be  scheduled  two  weeks  in  advance;  therefore,  student  contact  training  had  to  be 
delayed  necessitating  additional  refresher  flights.  Subjectively,  the  Ift  believed  that  the  ASUPT  was 
effective  for  Advanced  Contact  training,  even  though  for  the  reasons  stated  above,  the  data  reflect  less 
dramatic  confirmation. 

The  Formation  training  results  (Column  10)  require  comment.  Prior  to  this  study,  the  ASUPT 
formation  mode  had  been  used  only  by  experienced  pilots,  and  most  had  noted  difficulty  in  judging  closure 
rates  and  in  holding  a steady  fingertip  formation  position.  During  the  training  of  students  in  this  mode, 
additional  problems  were  evidenced.  When  the  computer  image  generation  system  became  overloaded,  it 
selectively  dropped  out  parts  of  the  lead  aircraft.  This  was  most  disconcerting  to  the  student  who  was 
trying  to  hold  position  and  to  learn  to  use  key  reference  points  which  frequently  disappeared.  SimBarly, 
discontinuities  occurred  when  the  lead  aircraft  passed  from  one  window  to  the  next  at  it  did  frequently 
during  the  early  training  periods.  As  a result  of  these  problems,  both  Ift  and  students  lost  confidence  in 
what  training  could  be  accomplished,  and  it  was  agreed  that  instead  of  training  to  criterion  performance, 
each  student  would  be  given  only  two  rides  in  the  ASUPT.  Further,  since  the  priority  was  low , if  scheduling 
problems  occurred,  formation  sorties  were  the  first  to  be  cancelled.  By  reference  to  Table  1,  it  may  be  seat 
that  three  students  received  no  formation  training  in  ASUPT.  Thus,  the  13%  figure  shown  in  Table  2, 
Column  10  was  derived  based  on  only  five  experimental  subjects. 

While  hours  saved  is  interesting,  a more  significant  measure  of  simulator  usefulness  with  respect  to 
cost  savings  is  the  training  effectiveness  ratio  (TER).  Such  a ratio  (Roscoe,  1971)  provides  an  estimate  of 
transfer  efficiency  as  indicated  by  the  ratio  of  practice  hours  saved  to  practice  hours  spent  in  a prior  device; 
the  higher  the  positive  number,  the  greater  the  transfer  efficiency.  For  this  study,  the  computation  was  as 
follows: 

Aircraft  Hours,  Control  Group  - Aircraft  Hours,  Experimental  Croup 

Simulator  Hours,  Experimental  Group  - Simulator  Hours,  Control  Group 

TERs  for  all  relevant  areas  of  training  are  provided  at  the  bottom  of  Table  2 and,  in  most  cases,  the 
TERs  tend  to  track  % Saved  estimates.4  However,  the  more  interesting  figure  is  the  ratio  of  1.00 
obtained  for  Formation.  This  ratio  indicates  that  on  the  avenge,  each  hour  spent  in  the  ASUPT  on  this 
training  task  resulted  in  a one  hour  savings  in  the  aircraft.  Thus,  it  appears  that  the  decision  to  de-emphasize 
formation  training  in  the  ASUPT  may  have  been  incorrect  even  though  all  persons  concerned  were  in 
agreement,  and  their  rationale  possessed  face  validity. 


* TER 


4Th«  denominators  for  instrument  and  nsvifation  TERs  were  derived  by  subtracting  rimulator  instrument  trainina 
accompfched  by  the  control  poup  (Table  1)  from  that  of  the  experimental  (roup  baaed  on  the  assumption  that  for  that 
level  of  task  training,  the  devices  were  approximately  equivalent. 
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Check  Hfc  Scone 

Avenge  instrument  end  contact  check  ride  worn  achieved  by  both  experimental  and  control  group* 
were  compared  to  obtain  aome  estimate  of  the  quality  of  graduated  students  (scores  of  passing  check  ridee 
wese  used).  For  instruments,  the  experimental  group  averaged  89.73%  and  the  control  group  89.82%;  not 
significantly  different 

On  contact  check  rides,  the  experimental  group  received  an  average  score  of  90.85%;  the  average 
score  achieved  by  conventionally  trained  students  was  87.35%.  This  difference  is  statistically 
significant  (p<01)  and  indicates  the  experimentally  trained  students  were  better  prepared  for  the  contact 
check  than  were  die  regular  students. 

As  noted  earlier,  the  performances  of  both  groups  of  students  were  followed  into  the  T-38  phase  of 
UPT.  In  the  T-38  phase,  the' experimental  students  of  dast  76-09  received  an  average  grade  of  91.77% 
while  the  regularly  trained  76—09  students  received  an  average  of  86.88%;  also  statistically  significant 
(pCOl).  These  data  suggest  that  whatever  additional  contact  flying  skills  were  learned  using  the  ASUPT  in 
tip  T-37  phase  were  retained  throughout  UPT. 

Motion/No-Motion 

Table  3 shows  the  ratio  by  training  category  (except  solo,  check  rides,  and  night  flying)  of  simulator 
and  flying  hours  used  by  the  four  students  who  trained  in  ASUPT  with  the  motion  turned  on  compared 
with  the  hours  used  by  die  four  students  who  trained  in  the  ASUPT  with  the  motion  system  turned  off. 
The  ratios  were  obtained  by  dividing  the  hours  used  by  the  motion  group  by  the  hours  used  by  the 
no-motion  group.  Remembering  that  all  subjects  were  progressed  on  a proficiency  basis,  die  ratios  show 
that  bcfch  groups  required  very  nearly  equal  hours  of  training  in  the  simulator;  Le.,  no  practical  or 
significant  differences  in  average  simulator  training  time  requirements  were  identified  that  could  be 
attributed  to  the  motion  condition.  The  ratios  further  show  no  practical  or  significant  differences  in  average 
aircraft  training  time  requirements. 


Table  3.  Ratios  of  Average  Horn 
Requbed  to  Complete  Training  by  Motion 
and  No-Motion  Groups  by  Training 
Segment  and  Device 


Tmlnbis  Ssfirwnt 

Rrtftot* 

SI  mu  1st  or 

111 

Basic  and  Presolo 

0.93 

1.02 

Advanced  Contact 

1.11 

0.95 

Instruments 

0.96 

1.02 

Navigation 

1.01 

0.97 

Total 

0.98 

1.01 

.Ratio  computed  by  dividing  the  average  number  of 
training  hours  requited  by  students  trebled  using  simulator 
motion  by  the  comparable  hours  used  by  students  trained 
without  simulator  motion. 


The  result  of  ASUPT  training  with  end  without  motion  suggest*  that  there  it  little  significant  I 

difference  in  training  value  between  these  conditions  anywhere  in  die  T-37  syllabus.  No-motion  students 
ware  given  training  in  stalls  with  motion  and,  had  they  not  been,  die  flying  hours  they  saved  in  basic 
contact  might  have  been  leu;  however,  there  was  no  confounding  in  any  other  of  the  sylabuu  categories, 
and  yet  the  motion/ no-motion  ratios  for  all  categories  including  basic  contact  were  nearly  die  same,  and 
very  doee  to  1.00. 
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IP  Judgements  as  to  ASUPT  CipabVtfcs 

A questionnaire  was  administered  to  the  IPs  (instructing  in  the  ASUPT)  after  they  had  die 
opportunity  to  observe  the  performance  of  the  ASUPT-trained  students  during  one  or  more  T-37  aircraft 
sorties.  The  objective  of  this  questionnaire  was  to  obtain  IP  attitudes  toward  die  ASUPT  and  their  opinions 
of  ASUPT  capabilities. 

Generally,  the  IPs  liked  the  ASUPT;  they  rated  it  much  better  than  the  T4  as  an  instructional  device, 
and  from  an  instructional  environment  viewpoint,  slightly  better  than  the  aircraft.  They  liked  the  flexibility 
allowed  by  some  of  the  advanced  instructional  provisions,  and  the  ability  to  select  weather  and  visibility 
conditions.  Various  negative  factors  were  identified;  but  the  principal  one  was  simply  that  IPs  Hke  to  fly 
aircraft. 

More  specifically,  the  IPi  judged  the  ASUPT  excellent  for  training  procedures  of  all  sorts  became  its 
flexible  reset  capability  allowed  convenient  and  rapid  repetition  of  training  events.  Another  strong  feature 
of  ASUPT  was  that  its  visual  display  enabled  effective  teaching  of  composite  references. 

The  questionnaire  also  revealed  a number  of  judged  drortcomings  in  ASUPT:s 

1 . The  visual  environment  was  inadequate  for  the  students  to  team  area  orientation,  although  they 
could  learn  to  locate  specific  visual  references. 

2.  Radio  transmissions  were  unrealistic  because  of  the  lack  of  background  chatter.  Students  did  not 
have  to  leant  to  sort  their  call  signs  out  of  the  noise. 

3.  The  absence  of  other  traffic  in  the  visual  environment  was  imreaUstic  and  reduced  the  capability 
to  teach  clea^ng  techniques. 

4.  During  the  final  turn,  movement  of  the  runway  image  from  one  cathode  my  tube  (CRT)  to 
another  was  not  smooth;  it  jumped  somewhat,  thereby  necessitating  unexpected  control  adjustments  which 
are  not  characteristic  of  real-life  requirements. 

5.  There  was  insufficient  ground  detail  in  the  visual  environment  durbig  the  final  approach  and  fiate 
for  landing  to  allow  students  to  adequately  judge  ground  proximity.  The  11b  recommended  that  ground 
textural  cues  be  added  in'  a rectangle  extendkig  three-quarters  of  a mile  back  from  the  runway  threshold 
and  extending  500  feet  on  both  sides  of  the  centerline.  (Both  two-  and  three-dimensional  cues  should  be 
investigated.)  They  also  recommended  that  cues  such  as  tire  marks  be  added  to  the  runway. 


IV.  FINDINGS 

This  study  was  exploratory  in  nature  in  which  six  objectives  were  addressed  using  a full  mission 
simulator  in  the  T-37  phase  of  UPT.  Following  is  a summary  of  findings  relative  to  eadi  objective: 

Objective  1 - Identification  of  syllabus  development  and  scheduling  problems.  First,  the  conduct  of 
the  flying  phase  of  this  study  in  which  students  were  progressed  on  a proficiency  basis  was  hampered  by 
inflexible  academic  prerequisites.  As  a result,  some  extra  aircraft  time  was  required  for  refresher  training. 
Second,  failures  on  instrument  (heck  rides  and  subsequent  short-notice  requirements  for  additional  aircraft 
sorties  proved  incompatible  with  existing  UPT  aircraft  scheduling  techniques  which  required  aircraft  sorties 
to  be  scheduled  two  weeks  in  advance.  Third,  batched  simulator  time  for  areas  of  training  in  which  students 
were  progressed  on  a proficiency  basis  conflicted  with  the  long  lead  time  required  to  obtain  aircraft  sorties 
for  .flight  skill  validation.  While  differences  in  student  learning  rates  caused  most  of  these  problems, 
differences  were  compounded  by  ASUPT  unreliability.  Although  an  89%  reliability  figure  for  die  study  was 
recorded,  occasional  ASUPT  component  failures  and  less  frequent  total  system  failures  caused  increased 
simulator  requirements  which  added  to  die  scheduling  problem.  The  usual  array  of  routine  problems  (Le., 
weather,  aircraft  aborts,  academic  failures,  illness)  which  occur  in  any  pUot  training  program  was 
experienced,  but  those  discussed  above  were  unique  to  use  of  a full  mission  simulator  and  impacted  the 


5 It  should  be  noted  that  many  of  these  items  have  been  supported  by  other  studies  conducted  law,  and  that  wbatv 
possible,  ASUPT  development  efforts  to  correct  the  problems  ate  fai  process. 
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results;  in  aO  cases,  Emulator  effectiveness  estimates  were  lowered.  These  data  highlight  a characteristic  of 
any  study  involving  the  use  of  Ml  mission  training  devices  in  an  operational  training  program;  if  innovative 
training  strategies  are  to  be  used  which  permit  most  efficient  use  of  a full  mission  simulator,  flexibility  must 
be  incorporated  into  the  total  program,  including  academic  training  and  aircraft  scheduling. 

Objective  2 - Identification  of  ASUPT  characteristics  which  need  further  development.  Potential 
areas  for  improving  ASUPT  capabilities  were:  formation  flying,  night  flying,  landing  approaches  and  flares, 
simplification  of  console  operation,  addition  of  random  aircraft  in  the  visual  scene  for  training  alertness, 
addition  of  more  realistic  random  radio  chatter,  and,  if  possible,  improved  system  reliability. 

Objective  3 - Provide  experience  in  using  total  ASUPT  capabilities.  Use  of  the  ASUPT  in  student 
training  indicated:  students  should  wear  personal  equipment  on  missions  just  preceding  aircraft  sorties; 
short  simulator  periods  are  more  efficient  in  early  training  and  longer  periods  towards  the  end;  student 
team  sorties  could  be  useful;  use  of  the  simulator  increased  training  efficiency  in  learning  to  use  composite 
reference;  some  portion  of  slow  flight  practice  should  be  accomplished  at  pattern  altitude;  to  keep 
motivation  up  over  a total  program,  performance  goals  must  be  specified  and  go-no-go  hurdles  instituted; 
most  simulator  sorties  should  be  conducted  with  the  IP  in  the  cockpit;  and  a console  operator  should  be 
available  to  assist  in  GCA  training. 

Objective  4 - Pretest  of  instrument  syllabus  for  use  with  the  IPS.  In  addition  to  several  relevant  items 
listed  above,  student  and  IP  comments  indicated  that  to  achieve  closer  relevance  with  the  problems  in 
aircraft  flights,  an  instrument  hood  (like  that  used  in  the  aircraft)  should  be  used  for  simulator  tides  which 
occur  just  prior  to  aircraft  instrument  training  sorties.  In  addition,  it  was  indicated  that  if  the  goal  of  a 
check  flight  only  in  the  aircraft  is  to  be  achieved,  the  aircraft  instrument  check  should  be  delayed  until  later 
in  the  syllabus;  i.e.,  after  navigation  training.  The  average  simulator  hours  scheduled  proved  to  be 
reasonably  accurate.  A final  simulator  check  ride  is  necessary. 

Objective  5 - Baseline  Training  Effectiveness  Data.  Percentage  estimates  and  training  effectiveness 
ratios  by  area  of  training  ate  provided  in  Table  2;  however,  it  must  be  reiterated  that  these  data  were 
obtained  in  an  exploratory  study.  If  a follow-on  study  of  this  type  is  conducted  which  incorporates 
corrective  measures  for  the  problem  areas  noted,  considerably  better  results  can  be  expected. 

Objective  6 - The  effects  of  motion  on  training  effectiveness.  The  sample  size  in  this  study  was  small; 
therefore,  inferences  concerning  the  value  of  simulator  motion  cannot  be  made  with  a high  level  at 
confidence.  However,  from  the  data  obtained,  there  is  no  support  that  a synergistic  six  degree-of-freedom 
motion  system  as  installed  on  the  ASUPT  increased  training  effectiveness  in  any  area  of  the  basic  T-37 
phase  of  UPT.  IP  users  did  indicate  a requirement  for  some  amount  of  heave  or  departure  motion  cueing 
when  teaching  stalls. 

V.  CONCLUSION 

This  study  has  clearly  shown  that  a sophisticated  full  mission  flight  simulator  can  be  used  to  increase 
training  effectiveness  in  the  context  of  Air  Force  UPT.  In  spite  of  the  difficulties  encountered  and  the 
exploratory  nature  of  the  study,  this  test  realized  a reduction  of  o re-quarter  of  the  regularly  scheduled 
flying  training  hours  at  a cost  of  only  two  simulator  hours  for  each  T-37  aircraft  hour.  The  mote 
spectacular  demonstrations  of  training  effectiveness  occurred  in  instrument  and  basic  contact  training;  t^e 
savings  in  instrument  training  has  precedent,  but  the  savings  in  basic  contact  training  indicates  an 
unexpioited  capability.  A subjective  assessment  of  the  difficulties  documented  in  this  study  indicates  most 
can  be  significantly  reduced,  if  not  eliminated  entirely.  This  assessment,  combined  with  the  positive 
opinions  of  ASUPT  IPs,  suggests  that  from  a training  effectiveness  viewpoint,  s full  mission  simulator  could 
be  developed  which  would  achieve  significant  benefits  in  all  major  training  areas  in  UPT;  the  degree  to 
which  such  a system  would  be  cost  effective  cannot  be  estimated  from  this  study. 


* Relevant  finding  bred  under  objectives  3 and  4 were  incorporated  end  validated  in  a subsequent 
APHRL/FT/ATC  test  of  the  proposed  IFS  syllabus. 
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